Improving A/D Converter 
Performance Using Dither 



1.0 INTRODUCTION 

Many analog-to-digital converter applications require low 
distortion for a very wide dynamic range of signals. Unfortu- 
nately, the distortion caused by digitizing an analog signal 
Increases as the signal amplitude decreases, and is espe- 
cially severe when the signal amplitude is of the same order 
as the quantizing step. In digital audio applications, for ex- 
ample, low-level signals occur often, sometimes alone and 
sometimes In the presence of larger signals. If these low- 
level signals are severely distorted by the quantization pro- 
cess, the usefulness of the system is greatly diminished. 
It is, in fact, possible to reduce the distortion, and also to 
Improve the resolution below an LSB (least significant bit), 
by adding noise (dither) to the signal of Interest. For Ideal 
converters, the optimum dither is white noise at a voltage 
level of about Ya LSB rms. The addition of dither effectively 
smoothes the ADC transfer function, which normally has a 
staircase-like appearance. The price one pays for the bene- 
fits of reduced distortion and improved resolution is a slight 
reduction of the signal-to-noise ratio. There are many appli- 
cations for which the benefits of dither are well worth the 
cost. Applications where the spectral distortion caused by 
the quantization of low level signals is particularly undesir- 
able will especially benefit from applying dither. These appli- 
cations include audio, acoustical Instrumentation, the analy- 
sis of rotating or vibrating machinery, and the characteriza- 
tion of the nonlinear distortion in electronic circuits. 
This application note introduces the concept of dither, its 
relation to quantization noise, and how it can Improve ADC 
performance. Additionally, experimental data are presented 
which explicitly show the effects of dither on a 10-bit con- 
verter. 
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FIGURE 1. Quantization without Sampling 
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2.0 SAMPLING AND QUANTIZATION 

Two processes which are inherent to the digital conversion 
of analog signals are sampling and quantization. It is impor- 
tant to review these processes and examine their effects on 
ADC noise. 

In analog sampling, a signal is "looked at" on only certain 
parts of Its waveform. Although most of the waveform Is 
"thrown away", all of the Information contained in the signal 
can be retained If the conditions of the sampling theorem 
are met. The sampling theorem requires that for the perfect 
reproduction of a signal, it is necessary to sample at a rate 
greater than twice the highest frequency component in the 
signal. Frequencies which are greater than the Nyquist fre- 
quency (half the sampling rate) will be aliased to lower fre- 
quencies, resulting In signal degradation. To prevent alias- 
ing, the Input analog signal must be processed through a 
low pass (anti-aliasing) filter, which allows only frequencies 
below the Nyquist frequency to reach the input of the ADC. 
With ideal sampling, no noise will be added to the signal. 
Unlike sampling, quantization inherently adds noise to the 
signal. In an ADC, a continuous range of voltages is con- 
verted to a discrete set of output codes (Figures 1 and 2 ). 
All voltages which fall within the same quantizing step are 
assigned to a single output code Thus, quantization una- 
voidably results In a loss of information. Adding bits to the 
converter improves the resolution, but the drawback is In- 
creased cost and complexity. 

The difference between an analog voltage and the voltage 
corresponding to Its digital output code (for ideal converters) 
is known as the quantization error. If one identifies an output 
code with the voltage at the center of Its range, the maxi- 
mum quantization error is ±q/2, where q Is the size of the 
quantizing interval (Figure 3). 




Analog Input 
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FIGURE 2. 3-Bit ADC Transfer Curve 




Analog Input (LSB) 
FIGURE 3. Quantization Error is ± Vz LSB for a Perfect ADC 
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FIGURE 4. Treatment of Quantizing Error as an Explicit Quantization Noise 



Alternatively, one can think of the quantization error in 
ADCs as a quantization noise which is added to a signal 
entering an ADC of infinite resolution (Figure 4). This is the 
way quantization error should be treated for the purposes of 
discussing dither. 

The presence of quantization noise limits the signal-to-noise 
(S/N) ratio attainable by an ADC. For large amplitude, com- 
plex signals, the quantization error from sample to sample 
will be statistically independent and uniformly distributed 
over the quantizing interval. The probability density P(v) for 
the quantization error v will be given by 



The signal-to-noise ratio in decibels is then 



P(v)^ 
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The rms noise v^oise is then 



v2P(v) dv 
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For an n-bit ADC, the largest sinusoidal signal that can be 
converted without clipping has a peak-to-peak amplitude of 
2" q. This corresponds to an rms level of 



^signal ' 



2n-1q 

V2 



20 log 



^signal 1 



■ Vnoise 
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, 2n-1 q/v'2 
20 log ^=- 



Thus, a 10-bit converter will have a maximum signal-to- 
noise ratio (for sinusoidal signals) of 62 dB. 
For large amplitude, complex signals, it can be shown that 
the quantization noise will be white (Appendix). This arises 
from the fact that for this type of signal, the quantization 
error for a large number of samples is uniformly distributed 
over the quantizing interval. For low level or simple (in terms 
of frequency content) signals, the quantization error cannot 
be treated as white noise added to the input signal. For 
example, let us look at a large amplitude, sinusoidal signal. 
(This is a simple signal, because it is composed of only one 
frequency.) If we digitize this with an ADC and then recon- 
struct it with a perfect DAC, we obtain what appears to be a 
sine wave with steps in it (Figure 5). These steps represent 
the various quantization levels in the ADC. If we were to do 
a spectral analysis of this reconstructed signal, we would 
see in addition to a peak at the input frequency, peaks at 
harmonics of the input frequency. The process of digitiza- 
tion has effectively added frequency components to the sig- 
nal. 
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FIGURE 5. A/D Converters Intierently Distort Signals 



Distortion is greatest in small amplitude, simple signals. For 
example the digitization of a sinusoidal signal with a peak- 
to-peak amplitude of 1 LSB will involve just two digital 
codes; the reconstructed waveform looks like a square 
wave (Figure 6). In this case, the quantization error is princi- 
pally in the form of odd-order harmonic distortion. 
Hence, for large, complex signals, the quantization noise is 
white. For small, simple signals, the quantization noise, be- 
cause it is mainly in the form of harmonic distortion, effec- 
tively adds frequency components to the signal. Spectral 
analysis of such a signal would give erroneous results. A 
spectrum of a large, complex signal, on the other hand, 
would only show the input signal, with a flat noise floor. 

3.0 DITHER 

To ameliorate the negative effects of quantization, early 
workers added analog white noise to the ADC input signal. 
In 1951 Goodain noticed that the addition of dither to sig- 
nals masked the contour effects in video systems. In 1960 
Widrow2 determined that the signal loss due to quantization 
is minimized if the quantization error is independent of the 
signal. Schuchman^ determined the forms of dither signals 
which yield a quantization error which is independent of the 
signal. He found that for ideal converters, the optimum dith- 
er is Vs LSB rms of white noise. Vanderkooy and Lipshitz^ 
showed that with dither, the resolution of an ADC can be 
improved to below an LSB. 



We now show how it is possible to reduce harmonic distor- 
tion and improve resolution in the A/D conversion of signals 
by adding dither. In Figure 6 we show a low level sinusoidal 
signal centered on a quantization step. The peak-to-peak 
amplitude of this signal is 1 LSB. When this signal is input to 
an ADC, it will be represented by only two codes. If the sine 
wave is centered on the threshold between the two codes, 
the digital output will represent a square wave. Any offset 
will change the duty cycle, but the digitized signal will always 
take the form of a series of pulses at the same frequency as 
the input. This is obviously a very poor representation of a 
sine wave. 

The addition of dither will cause the quantizer to toggle be- 
tween the two (and possibly additional) states more fre- 
quently (Figure 7). Sub-LSB information is preserved in the 
percentage of time spent between levels. With time averag- 
ing the resolution can be increased significantly beyond an 
LSB. What has been accomplished by adding dither is an 
effective linearization of the ADC transfer curve. A power 
spectrum of the output would show that the harmonic distor- 
tion arising from the quantization process has been signifi- 
cantly reduced, as compared to the case with no applied 
dither. What one pays for a reduction in total harmonic dis- 
tortion (THD) and improved resolution is a slightly degraded 
signal-to-noise ratio and, if one uses time averaging, an in- 
crease in the effective conversion time. 
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FIGURE 6. Quantization of Low Level Signals Results in Severe Error 
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FIGURE 7. With dither, sub-LSB information can be extracted from percentage of time spent between the two levels. 



Another way of looking at dither is by lool<ing at how it af- 
fects the ADC transfer curve. It fundamentally affects its 
meaning. With no dither, each analog input voltage is as- 
signed one and only one code. Thus, there is no difference 
in the output for voltages located on the same "step" of the 
ADC's "staircase" transfer curve. With dither, each analog 
input voltage is assigned a probability distribution for being 
in one of several digital codes. Now, different voltages with- 
in the same "step" of the original ADC transfer function are 
assigned different probability distributions. Thus, one can 
see how the resolution of an ADC can be improved to below 
an LSB. 

To illustrate the effects of dither on sinusoidal signals, a 10- 
bit A/D converter was connected as shown in Figure 8. The 
source of the dither is a pseudo-random noise generator. 
The dither must be attenuated so that at the ADC input, it 
has an rms level of Ys LSB, which is given by: 

1 Vref 

3 2" 



For a 1 0-bit converter with Vr^p = 5V, we have v^jufier = 
1.6 mV. The signal and dither are filtered through an 8th 
order Chebyshev low pass filter with a 20 kHz corner fre- 
quency (Figure 9). The signal is also AC coupled to remove 
any DC offset introduced by the op amps. The controllable 
DC offset (Figure 8) gives the ADC a unipolar input and 
allows one to center the signal with respect to the quantiza- 
tion levels. The A/D converter is the ADC1061, which is a 
10-bit, 1.8 JUS conversion time multi-step converter which 
operates from a 5V supply. 

For applications in the audio frequency range, one can use 
the MM5437 pseudo-random noise generator chip as the 
noise source (Figure 10). To convert from a pseudo-random 
digital waveform to white noise, one must low-pass filter the 
MM5437 output. This can conveniently be done through the 
anti-aliasing filter. Prior to filtering, the MM5437 output must 
be attenuated to a level which gives Vs LSB of dither at the 
ADC inpuL 
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FIGURE 8. Setup for Investigating the Effects of Dither 
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FIGURE 9. 8th Order Chebyshev Anti-Aliasing Filter 
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FIGURE 10. The MM5437 Digital Noise Generator is a convenient 
source of dither for applications in the audio frequency range. 



Figure 11a shows the spectrum, averaged 25 times, of a 
digitized 1 kiHz signal which has a peal<-to-peal< amplitude of 
1 LSB. Note the high relative amplitudes of the odd harmon- 
ics. With the addition of Vs LSB rms of wide-band dither, the 
only harmonic to be seen is a small fraction of the third 
(Figure 1 1b). Notice that the noise floor has increased rela- 
tive to the case in Figure 1 la. Figure 12 shows the spectrum 
of a 1/4 LSB signal with Vs LSB dither applied. Without dither, 
this signal could not be detected at all. In Figure 13 are 
displayed spectra for larger signals, with a peak-to-peak am- 
plitude of 5 LSB. 



Dither is very effective in reducing harmonic distortion for 
signal levels up to about 10 LSB. Beyond that, one gets into 
the transition region between low level signals, where the 
quantization produces harmonic distortion, and large sig- 
nals, where the quantization process produces white noise. 
Dither is also effective in ameliorating intermodulation dis- 
tortion. Figure 14a shows the effects of quantization on 
1 LSB amplitude signals with frequencies of 600 Hz and 
1 kHz. When 1/3 LSB of dither is applied, all the distortion 
products, both harmonic and intermodulation disappear. 



kil/VJl^JivJU-,..,v...^A_A\.^ 




Frequency (kHz) '" ' Frequency (kHz) 

TL/H/1 1320-15 

(a) (b) 

FIGURE 11. a) Spectrum of a 1 kHz, 1 LSB SignaL b) With dither, the 

harmonics have been eliminated. These spectra were averaged 25 times. 
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FIGURE 12. Without dither, this % LSB, 1 kHz signal could not be detected at all. The spectrum was averaged 50 times. 
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FIGURE 13. Effects of dither on larger signals (5 LSB). 
a) Without dither, b) With dither. These spectra were averaged 25 times. 
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(a) (b) 

FIGURE 14. a) Two 1 LSB signals at 600 Hz and 1 kHz show both 

harmonic and intermodulation distortion, b) With dither, only the fundamentals remain. 
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As one goes to higher resolution A/D converters, the inher- 
ent analog noise becomes a significant fraction of the opti- 
mum dither. For example, for a 12-bit converter operating 
from a 5V reference, Ys LSB corresponds to 400 (j,\/. If the 
inherent noise level is a few hundred microvolts but not 
close to 400 fiV, without any added dither the analog noise 
will cause a degraded signal-to-noise ratio without the bene- 
fits of a reduced harmonic distortion. Hence, for 12-bit or 
higher converters, such as the ADC12441 and ADC12451, 
dither is especially useful in improving performance. 

4.0. ALTERNATIVE DITHERING SCHEMES 

Before we end the discussion of dither, we should mention 
other dithering schemes. Depending upon the application 
and the degree of nonlinearity of the ADC, other types of 
dithering may be more appropriate than the white noise dith- 
er which we have discussed. The white noise dither is best 
for AC signals which cover a wide bandwidth, and for an 
ADC whose transfer function is close to ideal. 
If the ADC has significant differential nonlinearity, a better 
type of dither is narrow band noise centered at the Nyquist 
frequency. An amplitude of several LSB, on the order of 4 to 
5 LSB, will yield the best results. The amplitude of the dither 
needs to be higher because the spacing between codes will 
be higher due to the significant differential nonlinearity. 
A variation of the white noise dither is the subtractive white 
noise dithering technique. In this technique, the digital out- 
put of the pseudo-random noise generator is subtracted 
from the digitized result of the ADC. This has the effect of 
reducing the noise penalty of dithering. References 5 and 6 
discuss these other schemes in more detail. 

5.0. CONCLUSIONS 

This application note has attempted to introduce to the 
reader the concept of dither and how it affects A/D convert- 
er performance. The addition of Va LSB of wide-band noise 
to the input of an ADC has several beneficial effects. The 
dither will significantly reduce the harmonic and intermodu- 
lation distortion of small signals caused by the quantization 
process. With time averaging, resolution can be improved to 
levels significantly below an LSB. Fields such as audio 
where the spectral distortion caused by the quantization of 
low level signals is particularly undesirable will especially 
benefit from applying dither. 

APPENDIX 

We will determine the spectrum of quantization noise, as- 
suming that the quantization error from sample to sample is 
statistically independent. This condition will be met for large 
amplitude, complex signals. The autocorrelation function of 
the noise, RwM, is defined by 
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Since the quantization error from sample to sample is inde- 
pendent, the autocorrelation function must be zero for |x| > 
tg, where tg is the time between samples. If we take into 
account the fact that the ADC maintains its output until the 
result of the next conversion is available, then it is legitimate 



to speak of times which are between sample times. The 
autocorrelation function is then 



X < ts 



X > t. 



The value of Rvv(x) at x = corresponds to the mean 
square value of the quantization noise, q2/12. The power 
spectrum of a signal is the Fourier transform of its auto- 
correlation function, hence for the power spectrum of the 
noise we get 
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The corresponding linear spectrum is 
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This spectrum actually represents the convolution of the 
quantization noise, g(t), with a square pulse, h(t), of width tg 
and amplitude 1/tg. 



L(a)) 
where G{a)) 



F(g(t) • h(t)i 
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The square pulse arises from the fact that the ADC output is 
held fixed between samples. The Fourier transform of the 
square pulse is [sin (o)tg/2)]/(ft)ts/2). Hence, the power 
spectrum of the quantization noise itself is 
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Since this is not frequency dependent, we have shown that 
the spectrum of quantization noise is white. 
We can also determine the spectrum of the quantization 
noise by explicitly taking the sampled nature of an ADC into 
account. In this case, the output of the quantizer is defined 
only when the signal is sampled. The autocorrelation func- 
tion of a discrete function is defined by a sequence of N 
terms, each of which is given by 
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where N samples are taken spaced by an interval tg. Since 
the quantization error from sample to sample is indepen- 



dent, the only nonzero term in the sequence will be the one 
for m = 0. This term represents the mean square value of 
the quantization noise, q2/l2. Hence, the autocorrelation 
function is the sequence 



Rw (m h) 



. 0, 0, q2/12, 0, 0, 



The power spectrum of the quantization noise, which is the 
Fourier transform of its autocorrelation function, is given by 
the sequence of N terms, each term of which is given by 
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where Cl = 27r/Nts. Since the only nonzero value of 
Rvv(ni ts) i" 'he sequence is for m = 0, the equation above 
reduces to 

P(kf!) = Rv„(0) = q2/12 
Since the expression for P(kfl) is independent of k, every 
term in the power spectrum will be identical; therefore, the 
quantization noise will be white. 



Hence, we have shown, using two different approaches, 
that the quantization noise for a large amplitude, complex 
signal will be white noise. 

REFERENCES 

1. W.M. Goodall, "Television by Pulse Code Modulation," 
BellSys. Tech. J., vol. 30, pp. 33-49 (1951). 

2. B. Widrow, "Statistical Analysis of Amplitude-Quantized 
Sampled-Data Systems," Trans. AIEE (Applications and 
Industry), vol. 79, pp. 555-568 (1960). 

3. L Schuchman, "Dither Signals and Their Effect on 
Quantization Noise," IEEE Trans. Commun. Technol, 
vol. COM-12, pp. 162-165 (1964). 

4. J. Vanderkooy and S.P. Lipshitz, "Resolution Below the 
Least Significant Bit in Digital Systems with Dither," J. 
Audio Eng. Soc, vol. 32, pp.106-113 (1984 Mar.); cor- 
rection ibid., p. 889 (1 984 Nov.). 

5. B. Blesser and B. Locanthi, "The Application of Narrow- 
Band Dither Operating at the Nyquist Frequency in Digi- 
tal Systems to Provide Improved Signal-to-Noise Ratio 
over Conventional Dithering," J. Audio Eng. Soc. , vol. 35, 
pp. 446-454(1987 June). 

6. J. Vanderkooy and S.P. Lipshitz, "Dither in Digital Au- 
dio," J. Audio Eng. Soc, vol. 35, pp. 966-974 (1987 
Dec). 



0) 



Q 

a> 

c 

"55 

0) 

o 

c 

(0 

E 



0) 
Q. 

0) 

> 
c 
o 
o 



< 

c 

■> 
o 

E 



LIFE SUPPORT POLICY 



NATIONAL'S PRODUCTS ARE NOT AUTHORIZED FOR USE AS CRITICAL COMPONENTS IN LIFE SUPPORT 
DEVICES OR SYSTEMS WITHOUT THE EXPRESS WRITTEN APPROVAL OF THE PRESIDENT OF NATIONAL 
SEMICONDUCTOR CORPORATION. As used herein; 

1. Life support devices or systems are devices or 2. A critical component is any component of a life 



systems which, (a) are intended for surgical implant 
into the body, or (b) support or sustain life, and whose 
failure to perform, when properly used in accordance 
with instructions for use provided in the labeling, can 
be reasonably expected to result in a significant injury 
to the user. 



support device or system whose failure to perform can 
be reasonably expected to cause the failure of the life 
support device or system, or to affect its safety or 
effectiveness. 
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